A Simple Vision-Based Algorithm for Decision Making in Flying Drosophila

Animals must quickly recognize objects in their environment and act accordingly. Previous studies indicate that looming visual objects trigger avoidance reflexes in many species 1, 2, 3, 4, 5; however, such reflexes operate over a close range and might not detect a threatening stimulus at a safe distance. We analyzed how fruit flies (Drosophila melanogaster) respond to simple visual stimuli both in free flight and in a tethered-flight simulator. Whereas Drosophila, like many other insects, are attracted toward long vertical objects 6, 7, 8, 9, 10, we found that smaller visual stimuli elicit not weak attraction but rather strong repulsion. Because aversion to small spots depends on the vertical size of a moving object, and not on looming, it can function at a much greater distance than expansion-dependent reflexes. The opposing responses to long stripes and small spots reflect a simple but effective object classification system. Attraction toward long stripes would lead flies toward vegetative perches or feeding sites, whereas repulsion from small spots would help them avoid aerial predators or collisions with other insects. The motion of flying Drosophila depends on a balance of these two systems, providing a foundation for studying the neural basis of behavioral choice in a genetic model organism

Reactive direction control for a mobile robot: A locust-like control of escape direction emerges when a bilateral pair of model locust visual neurons are integrated

Locusts possess a bilateral pair of uniquely identifiable visual neurons that respond vigorously to the image of an approaching object. These neurons are called the lobula giant movement detectors (LGMDs). The locust LGMDs have been extensively studied and this has lead to the development of an LGMD model for use as an artificial collision detector in robotic applications. To date, robots have been equipped with only a single, central artificial LGMD sensor, and this triggers a non-directional stop or rotation when a potentially colliding object is detected. Clearly, for a robot to behave autonomously, it must react differently to stimuli approaching from different directions. In this study, we implement a bilateral pair of LGMD models in Khepera robots equipped with normal and panoramic cameras. We integrate the responses of these LGMD models using methodologies inspired by research on escape direction control in cockroaches. Using ‘randomised winner-take-all’ or ‘steering wheel’ algorithms for LGMD model integration, the khepera robots could escape an approaching threat in real time and with a similar distribution of escape directions as real locusts. We also found that by optimising these algorithms, we could use them to integrate the left and right DCMD responses of real jumping locusts offline and reproduce the actual escape directions that the locusts took in a particular trial. Our results significantly advance the development of an artificial collision detection and evasion system based on the locust LGMD by allowing it reactive control over robot behaviour. The success of this approach may also indicate some important areas to be pursued in future biological research

A fast and flexible panoramic virtual reality system for behavioural and electrophysiological experiments

Ideally, neuronal functions would be studied by performing experiments with unconstrained animals whilst they behave in their natural environment. Although this is not feasible currently for most animal models, one can mimic the natural environment in the laboratory by using a virtual reality (VR) environment. Here we present a novel VR system based upon a spherical projection of computer generated images using a modified commercial data projector with an add-on fish-eye lens. This system provides equidistant visual stimulation with extensive coverage of the visual field, high spatio-temporal resolution and flexible stimulus generation using a standard computer. It also includes a track-ball system for closed-loop behavioural experiments with walking animals. We present a detailed description of the system and characterize it thoroughly. Finally, we demonstrate the VR system’s performance whilst operating in closed-loop conditions by showing the movement trajectories of the cockroaches during exploratory behaviour in a VR forest

Non-Linear Neuronal Responses as an Emergent Property of Afferent Networks: A Case Study of the Locust Lobula Giant Movement Detector

In principle it appears advantageous for single neurons to perform non-linear operations. Indeed it has been reported that some neurons show signatures of such operations in their electrophysiological response. A particular case in point is the Lobula Giant Movement Detector (LGMD) neuron of the locust, which is reported to locally perform a functional multiplication. Given the wide ramifications of this suggestion with respect to our understanding of neuronal computations, it is essential that this interpretation of the LGMD as a local multiplication unit is thoroughly tested. Here we evaluate an alternative model that tests the hypothesis that the non-linear responses of the LGMD neuron emerge from the interactions of many neurons in the opto-motor processing structure of the locust. We show, by exposing our model to standard LGMD stimulation protocols, that the properties of the LGMD that were seen as a hallmark of local non-linear operations can be explained as emerging from the dynamics of the pre-synaptic network. Moreover, we demonstrate that these properties strongly depend on the details of the synaptic projections from the medulla to the LGMD. From these observations we deduce a number of testable predictions. To assess the real-time properties of our model we applied it to a high-speed robot. These robot results show that our model of the locust opto-motor system is able to reliably stabilize the movement trajectory of the robot and can robustly support collision avoidance. In addition, these behavioural experiments suggest that the emergent non-linear responses of the LGMD neuron enhance the system's collision detection acuity. We show how all reported properties of this neuron are consistently reproduced by this alternative model, and how they emerge from the overall opto-motor processing structure of the locust. Hence, our results propose an alternative view on neuronal computation that emphasizes the network properties as opposed to the local transformations that can be performed by single neurons

An Alternative Theoretical Approach to Escape Decision-Making: The Role of Visual Cues

Escape enables prey to avoid an approaching predator. The escape decision-making process has traditionally been interpreted using theoretical models that consider ultimate explanations based on the cost/benefit paradigm. Ultimate approaches, however, suffer from inseparable extra-assumptions due to an inability to accurately parameterize the model's variables and their interactive relationships. In this study, we propose a mathematical model that uses intensity of predator-mediated visual stimuli as a basic cue for the escape response. We consider looming stimuli (i.e. expanding retinal image of the moving predator) as a cue to flight initiation distance (FID; distance at which escape begins) of incubating Mallards (Anas platyrhynchos). We then examine the relationship between FID, vegetation cover and directness of predator trajectory, and fit the resultant model to experimental data. As predicted by the model, vegetation concealment and directness of predator trajectory interact, with FID decreasing with increased concealment during a direct approach toward prey, but not during a tangential approach. Thus, we show that a simple proximate expectation, which involves only visual processing of a moving predator, may explain interactive effects of environmental and predator-induced variables on an escape response. We assume that our proximate approach, which offers a plausible and parsimonious explanation for variation in FID, may serve as an evolutionary background for traditional, ultimate explanations and should be incorporated into interpretation of escape behavior

Measuring neural correlates of insect escape behaviors using a miniature telemetry system

Journal ArticleThe firing patterns of visual neurons tracking approaching objects need to be translated into appropriate motor activation sequences to generate escape behaviors. Locusts possess an identified neuron highly sensitive to approaching objects (looming stimuli), thought to play an important role in collision avoidance through its motor projections. Although the sensory and motor side of the system have been studied extensively in the past, an integrative study of the sensory-motor transformations underlying escape behaviors has been missing. Furthermore, such sensory-motor transformations can best be studied by instant monitoring of the brain's visual and motor activities in freely behaving locusts, which has been a challenging feat because of the insect's small size. Here we present a miniature telemetry system and its use for acquiring neural, muscle, and acceleration data from a freely escaping locust